Search for: All records

Abstract Spiking Neural Networks (SNNs) have emerged as a compelling, energy-efficient alternative to traditional Artificial Neural Networks (ANNs) for static image tasks such as image classification and segmentation. However, in the more complex video classification domain, SNN-based methods fall considerably short of ANN-based benchmarks, due to the challenges in processing dense RGB frames. To bridge this gap, we propose ReSpike, a hybrid framework that synergizes the strengths of ANNs and SNNs to tackle action recognition tasks with high accuracy and low energy cost. By partitioning film clips into RGB image Key Frames, which primarily capture spatial information, and event-like Residual Frames, which emphasize temporal dynamics cues, ReSpike leverages ANN for processing spatial features and SNN for modeling temporal features. In addition, we propose a multi-scale cross-attention mechanism for effective feature fusion. Compared to state-of-the-art SNN baselines, our ReSpike hybrid architecture demonstrates significant performance improvements (e.g., >30% absolute accuracy improvement on both HMDB-51 and UCF-101 datasets). Additionally, ReSpike is the first SNN method capable of scaling to the large-scale benchmark Kinetics-400. Furthermore, ReSpike achieves comparable performance with prior ANN approaches while bringing better accuracy-energy tradeoff. 

Abstract Regularity and singularity of the solutions according to the shape of domains is a challenging research theme in the Boltzmann theory. In this paper, we prove an Hölder regularity in for the Boltzmann equation of the hard‐sphere molecule, which undergoes the elastic reflection in the intermolecular collision and the contact with the boundary of a convex obstacle. In particular, this Hölder regularity result is a stark contrast to the case of other physical boundary conditions (such as the diffuse reflection boundary condition and in‐flow boundary condition), for which the solutions of the Boltzmann equation develop discontinuity in a codimension 1 subset (Kim [Comm. Math. Phys. 308 (2011)]), and therefore the best possible regularity is BV, which has been proved by Guo et al. [Arch. Rational Mech. Anal. 220 (2016)].